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ABSTRACT. We propose an explicit construction of a stationary solution for a stochastic 
recursion of the form X o = (p(X) on a partially-ordered Polish space, when the mono- 
tonicity of <p is not assumed. Under certain conditions, we show that an extension of the 
original probability space exists, on which a solution is well-defined, and construct explic- 
itly this extension. We then provide conditions for the solution to be defined as well on the 
original space. We finally apply these results to the stability study of two non-monotonic 
queueing systems. 
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1. Introduction 

The evolution of a number of dynamical systems depend on punctual, random pertur- 
bations which may be assumed time-stationary. In such cases, the state of the system can 
be described, in discrete time, by a random sequence generated by a recursive, random 
functional termed driving mapping of the recursion: 

X n+ i = % (X n ) , n > 0. 

In the general framework (of crucial interest in the application), where the sequence {<p„} 
driving the recursion is time-stationary but not necessarily independent, we adopt an ergodic- 
theoretical approach to formally address the central question of stability, i.e. of existence 
of an equilibrium state for the recursion. 

It is well-known since the pioneering works of Loynes (see [11] and among others, J4|), 
that a stationary state exists whenever the random maps <p„ enjoy mild properties, such as 
(i) monotonicity and continuity, as assumed by Loynes, or (ii) some regenerative property, 
as in Borovkov's Theory of Renovating Events (see 0). Notice that the latter framework 
is also suitable, under certain conditions, for random sequences that are not stochastically 
recursive, see Q. 

However, a lot of (even very simple) models don't verify such assumptions. A classical 
example is the well-known so-called Loss queueing system, addressed in section [5}. It is 
easy to construct cases in which either none, or several stationary states may exist. For this 
particular model, Neveu lfl3l and Flipo 1 8 , 9 1 have shown that the stability problem can be 
solved at least on a larger probability space. Their constructions, inspired by skew-product 
methods used to solve ordinary or partial differential equations, lead to an extension (also 
called enrichment) of the original probability space on which a stationary solution exists 
(see as well Lisek iflOl for related developments). 

More recently, Anantharam and Konstantopoulos [U [2] show that such extensions ex- 
ist under mild assumption on the statistics of the recursion, using an approach based on 
tightness properties. The construction presented in [HI2, although more general, is less 



2 



P. MOYAL 



tractable in that the probability measure on the extension (termed weak solution) is identi- 
fied as a weak limit, and is not explicitly defined. 

Following the same directions, we aim to identify the conditions of existence of such 
extensions, for a more general class of models. We also propose, under such conditions, a 
constructive scheme of the enriched probability space - see Theorem[T]below. Our frame- 
work appears particularly adequate, when coming back to the original problem: it leads 
to several sufficient conditions of existence of a stationary state on the original probability 
space (see Proposition [3). Then, Loynes's Theorem and Borovkov and Foss's Theorem 
of Renovating events turn out to be particular cases of our result (see subsections 14. 31 and 
14.4b . As a matter of fact, the three approaches all rely on the same time reversal technique 
(usually termed Backwards scheme). We therefore term our construction Generalized back- 
wards scheme. 

The outline of this paper is the following. After introducing our main notation and 
assumptions in section |2j we give in section [3] a sufficient condition of existence of an 
extension solving the recursion, based on the tightness argument of Anantharam and Kon- 
stantopoulos (ibid). The main result of this work is presented in section [4] we construct 
explicitly the extension, and deduce several conditions for solving the original stability 
problem. We conclude with two cases study: in section[5]we handle in this framework the 
stability problem of the Loss queueing system. Finally, in Section [6] we address the same 
problem for a generalization of this model: the Queue with impatient customers. 

2. Preliminary 

Let E be a Polish space that is endowed with a partial ordering For all x.y € E such 
that x if! y, we denote 

[*,y] :={zeE-x^z^y}. 
We assume that E admits a ^-minimal point denoted 0^, and is Lattice-ordered: any <- 
increasing sequence converges (possibly to some element of the adherence of E). Any 
subset A C E is said locally finite if for any compact subset C C E, A n C is of finite 
cardinal. We equip E with its Borel d-field S . 

Let Z, N and N* denote the sets of integers, of non-negative integers and of positive 
integers, respectively. We denote for any x,y S M, xWy = max(x,y), xAy = min(x,y) and 
x+ =iV0. 

Consider a probability space (£2, J£",P), furnished with the measurable bijective flow 
9 (denote _1 , its measurable inverse). Suppose that P is stationary and ergodic under 
9, i.e. for all srf € J 5 ", P [d~ l £/] = V[ef\ and all that is 0-invariant (i.e. such that 
Qstf = stf) is of probability or 1. Note that according to these axioms, all 0-contracting 
event (such that P [jrf c n9"V] = 0) is of probability or 1. We denote for all n E N, 
9" = 9 o 9 o ... o 9 and 9~" = 9~ l o o ... o Except when explicitly mentioned, 
throughout all the random variables (r.v.'s for short) are defined on (£2, J^",P). Under such 
conditions, the quadruple (£2, J^,P, 9) is termed stationary ergodic dynamical system. 

We denote JK{E) the set of measurable mappings from E into itself. For any j$(E)- 
valued r.v. F, for any x G E, let F m (x) be the image of x through F for the sample (0. For 
an Y / £ ^(E), and any subset B C E, we denote f(B) = {f(x);x € B}, and accordingly 
for any „#(£)-valued r.v. F and all sample co, F m (B) = {F m (x);x € B}. 

Let (p be a ^(£)-valued r.v.. For all Zs-valued r.v. X, let {Xy,„} nGN be the stochastic 
recursion initiated by X and driven by <p, i.e., such that P-a.s., 

\ X x .o =X; 

{ X x ,„+i =<po9" {X x ,„) , for all n e N. 
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Define for all sample 0), all n and x G E, 

*S»W =X x , n (9-"co) =<p e - llo o< Pe -2 m o...o< Pg -, 1(0 ( x ). 

The r.v. <3>"(x) represents the value of the recursion driven at time when starting at the 
iteration — n from the deterministic value x. In other words, 

<t>l( x )=x x .„oe-". 

We investigate the existence of a stationary version of the sequence {Xx,n} ne m, i- e - sucn 
that Xx.„ — XoQ" for all n G N. Then it is easily seen that the r.v. X solves the functional 
equation 

(1) Xo9 = (p{X) a.s.. 

The existence of a solution to (fl~|i on the original probability space is not granted in general, 
without further assumptions on (p. We aim to construct an extension of the probability 
space, on which a solution exists. 

3. An existence result 

Let us assume throughout this section that the couple (£2, j?) is Polish (i.e. £2 is Pol- 
ish and & is a sub-c-algebra of the Borel <7-algebra of £2). Under certain conditions, 
the existence of an extension on which ([TJ admits a solution, is granted by Anantharam 
and Konstantopoulos's Theorem (see (U 12). This result, which identifies the probability 
measure on the extension as a weak limit, strongly relies on the property of tension of the 
embedded sequence of random variables. The latter holds, in particular, under the follow- 
ing domination assumption. 

(HI) For some ^ (E)-valued r.v. y, 

• forallx G E, Oe < (p(x) ^ yf(x), V — cls.; 

• \j/ isP-a.s. <-non decreasing and continuous; 

• the following recursion admits at least one E -valued solution: 

(2) YoO = \]/(Y). 
We have the following result. 

Proposition 1. Suppose that (HI) holds, and that either one of the two following conditions 
holds: 

(H2) <p is P-a.s. continuous; 

(H3) <p admits a.s. a finite number of discontinuities, and there exists a locally finite 
subset Oe G L C E that is P-a.s. stable by (p. 
Then, there exists an extension (£2, J^",P, 0) o/"(£2, j^",P, 9), that is such that 

• P is a 9-invariant probability on £2 having Q-marginal P, 

• there exists a E x ^(E)-valued r.v. (X,(p) defined on £2 by (0, such that the 
Q-marginal of (p is the distribution of <p, and such that 

Xo 6 = (p(X), P-a.s.. 

Proof. This result is a consequence of Theorem 1 in flT|, whose hypothesis are completed 
in [2|. Define 

• £2:=£2x£, 

• for all (co,x) G£2, 9(co,x) = (9G),<p a (x)) . 
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As an immediate consequence of Loynes's Theorem for stochastic recursions ( |[TTl l4"l0. 
there exists a solution, say K*,, to (0. The r.v. K*. is given by the a.s. limit of the sequence 
{Yo E , n ° 0"}„ g n ( see section |431 below). Note, that Y„ may in general be improper (i.e. 
valued in some E D E). However, F«, is ^-minimal among all the solutions of (f2]) (again, 
see 14. 31 ). and the last assertion of (HI) entails that K» is £-valued. 

In particular, the sequence {Yo En } n€N tends weakly to Yoo. It is thus tight (Prohorov's 
Lemma): for all e > 0, there exists a compact subset K £ of E such that for all n G N, 

P[Yo E ,n£K e ]>l-e. 

Thus, as E is Lattice-ordered, there exists M e G E s.t. 

P[%,« <M £ ] > 1-e. 

In view of the first assertion of (HI), an immediate induction shows that 

Xq e ,„ < Yq e .„, neN a.s., 

so that 

P[X 0e .„^M £ ] > 1-e, neN, 
which shows the tightness of {Yo E ,n} ne ^- 

Remark that for all n 6 N, G & and 3S G S, 

P(gx5o £ [e- n {*/xE)] =p[e-"^] =pm 

and 



P®8q e [fl-"(flx^] = P®5 ( 



'<>£ 



|(fl),x) 6fl;3^(fl)) G^j 



P[X 0£ ,„G^]. 



Hence, the probability distributions {(P® 5o £ ) o d~"} neN on A have £2-marginal P and 
^-marginals, the distributions of {Xo E/l } ne ^, which form a tight sequence. The sequence 
{(P® 5q e ) o 9~ n } nefj is thus tight. Therefore, any sub-sequential limit is a good candidate 
for P provided that it is 0-invariant. This property holds under either one of conditions 
(A1)-(A3) p. 271-272 in J2). First, under condition (H2), the shift is continuous from 
fix E into itself, which is condition (Al) in Q. 

Let us now assume that (H3) holds. Define for all (0, {dj(<X>)} . &J , the set of disconti- 
nuities of <p m and 

5(o) = inf{|| dj{(o)-d k {(o) \\;j,keJ m }. 
Let us define the following events. 

^={Cai-d7<oo} ; 

For all p £ N*, S p = {s < 2^-^} . 

Note that by hypothesis, P ]&\ = 1, and thus P [<5 > 0] = 1 . Fix p G N* and a sample (O G 9. 
For all j G J a , define C(o tP j as follows : 

(a) if for some k G Jm , \\ dj(03) — dk((0) \\< 2~( p ~ l \ Ca,,p,j is the open bowl of center 
dj(co) and radius 5; 

(b) otherwise, C m ,pj is the open bowl of center dj((o) and radius 2~ p , 
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so that the bowls C miP j, j € ■/<», don't intersect. We define finally 

and aim to construct a continuous function <p ra ;; , from E into itself, such that q> m . p coincides 
with <p ra outside the open set C m p . For doing so, fix j and let x G C m:P j. There exists y in 
the frontier C m ,pj of Ca> lP j such that for some 77 < 1 , 

x-dj(co) = rj.(y-dj(co)) . 

Then, we set 

<Pa>,p,j(x) '-=2 P \\x-dj(co) || ,<p(y) incase (a), 

<Pa,p,j(x) ■= \\x-dj(co) || .<p(y) incase (b). 

The function (Pa.pj, hence radially defined, is clearly continuous on the bowl. Defining 
now for all x € E, 

<p m (x) if x^Caj, 
<P(o,pj( x ) if X G C(o,pj, 
we obtain the desired function. 

Finally, define the family of shifts B p , p > 1 for all (co,x) G £2 by 

9p(0),jc) = (efl),^ )P (x)). 

The Bp, p >l are then continuous from £2 into itself. Now fix again p > 1 . It is clear from 
(H3) that for all i > 1, 4> ! (0 B ) G L a.s., hence 

P[{a);4> , fi) (0ir)GC (1) , p }n^] < P [{to;LnC aj> ^ 0} n#] . 

Finally, set 

% = {(co,x) € £l;x e Ca>,p} ■ 
Then, ^ p is an open subset of £2, and in view of the latter inequality, 



<Pa,p(x) = 



1 1 

limliminf- V (P® SJ o 6~ l (%) 



< limliminf- V PrjO' fOE) GC„)n^l 

< limP[{LnCp^0}n^] 



< limP 

= 0, 



L 



since L is locally finite. Consequently, Assumption (A3) p. 272 of JH is satisfied. Hence, 
from Theorem 1 of [ 1 1, there exists a ^-invariant probability P on £2 x R whose £2-marginal 
is P, given by any sub-sequential limit of { (P Cg> 5q e ) o 0"}„ gN - 
Now, define on £2 the random variables 

(3) X(a,x) :=x, q> m ,x ■= (Pa>- 
We then have that 

(4) Xo8(co,x) = <p m (x) = Ww,x(x) = 9B)^(X(fl),jc)),P-a.s., 
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hence X is a proper solution to (Q} on (0,^",P, 0). □ 

4. Explicit construction 

We present the main result of this work. Under certain conditions, we can construct 
explicitly an extension solving equation ([TJ. For doing so, we follow an argument related 
to that developed by Flipo 1 8 1 and Neveu [13] for the recursion describing the workload of 
a loss queueing system G/G/l/1. 

We start with a random set G satisfying 

(5) (Pco(Gco) C G gm , as., 

which is checked e.g. by G = E, or any deterministic set that is a.s. stable by <p. Now 
denote for all n G N* 

(6) Hl:=^l(G e - no} ), 

the set of all possible values of the recursion driven by <p at 0, when letting the value at — n 
vary over the set Gg-n m . Let us first remark that 

Lemma 1. The sequence of random sets {H"} neN decreases for inclusion: 

(7) G D// 1 DH 2 D ... DH" D ... a.s.. 
Proof. That 

H i = <Pe-^m ( G e-i J £ Geo, a.s., 
simply follows from (0. Now, let n G N*. We have a.s. for all x g H a +l , that for some 

y e G e-(»+>W 

x = <^ +1 (y) = ^(<p e _ (B+1)fl ,(y)). 
since y G G _(„ +1)(B , we have that (p e -( n +\) m (y) G G e -n m in view of ©, hencex G H a +l . □ 

We can thus define, a.s., 

(8) H m =]imH^= C\Hl<ZG a . 

n>l 

Lemma 2. Assume that (0), and the following condition hold: 

The random set H defined by ([8]) is such that 

(9) P [H is finite and non-empty] > 0. 

Then, the mapping <p is bijectivefrom H to HoQ, a.s.. The r.v. Card// is thus deterministic, 
denoted by c. 

Proof. Take a sample co in the event 

^ :— {H is finite and non-empty }. 
For any x G H a , for all n > 1, there exists y„ G G e -„ m such that x = <& n a {y n )- Therefore, 

<Pco (x) = (Pco o %- 1 m o . . . o (p e -, 1(0 (y„ ) = <t>" e + m 1 (y„ ) , 
where G e -(„ + i) e „. This is true for all n > 1, hence (p w {x) belongs to the set 

fl *e<» ( G e-'Wio) = fl H eo> = H em, 

n>2 n>2 
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so that <p<a maps H m onto Hq^. Consequently, 

(10) ?c^n{#)cflo0} 

c e~ V. 

Hence, ^ is 0-contracting, and then almost sure in virtue of (|9j. So is the event on the 
r.h.s. of ([Toll, thus 

O<Card//o0< Card//<°°, a .s.. 

But 

P [Card// o 9 < Card//] > 

would then imply that 

E [(Card//) o 6 - Card//] < 0, 

a contradiction to the Ergodic Lemma ([4|, Lemma 2.2.1). Therefore, 

(Card//) o = Card// a.s., 

which shows that Card// is deterministic, say equal to c a.s.. 

Now, to check that <p is a.s. surjective, fix a sample 0) on the almost sure event 

{Card H = c} n _1 {Card // = c} , 

and y € Z/eo. In particular, for any n > 1, for some 

we have that 
where 

y« = <Pe- 1 ffl°--- 0( Pe-«a>(*n+i) = 3 ) ffl (jc„+i) e//^. 

Hence, 

y„en < P«'(^) = <p(n^) J 

n>l \n>l / 

where the last equality follows from Lemma [JJ Therefore, <p<a is surjective from H a into 
Hg m , and hence bijective since these two sets have the same cardinal. □ 

We are now in position to construct an enrichment of the original probability space 
(£2, ^,P, 9) on which the existence of a solution to (UJ is granted. 

Proposition 2. Suppose that Q and $9} hold true. Then, the quadruple (£2,J^",P,0) 
defines a stationary dynamical system: 

• £1 = {(co,x) e£lxE;xeH m }; 

• & is the trace of ' & ' ®S onCl, i.e. 



where srf £ J?" and 3§ £ j . 



• For all 6 of the above form, 



P[Jk] = - I l^(a))Card {H m f\@) dP{co); 



c Jn 

• For all (co,x) G £2, 0(co,x) = (00), (^(jc)) 



X 
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Proof. To check this, first remark that defines an automorphism of £2 in view of Lemma 
|2] On another hand, P defines a probability measure, since it clearly is a <7-finite measure, 
that is such that 

P [&] = - [ l n (o))Card (H m DE) dP(co) = 1. 



C JQ. 

Notice as well that P has £2-marginal P since for all g# G J?, 

(11) PU^xE] = - [ \Aco)Card (H m nE)dP(co) = PW. 

c Jo. 

Now, fix jk := {(co,x) G £2; co G g/, x G &C\H a } G Then, remarking that 9(co,x) G 
amounts to 9 CO G and (pio(x) G S§r\Hg m , we have that 



1 

c Ja 



But in view of Lemma|2] 

Card ( {(par^^riHe^nHa ) = Card ( (<p a )- 1 (&r\H g<0 ) 



= Card (^nH ea ), 

so by 0-invariance of P, 

p[6- l £f] = - ( l^(0to)Card (^rW eo ,) dP(o) 



C JQ. 



- [ l 5 /(0))Card (@nH a )dP((o) 
c Jo. 



which first shows the measurability of and second, the 0-invariance of P. The 
proof is complete. □ 

The quadruple (£2, J^,P, 0) is an enrichment of (£2, J^,P, 9): the first space is projected 
onto the second one by the mapping 

£2 — >£2 

(co,x) i > CO, 



f: 

and for all s# G J\ 



Pof 1 \sf\ = ~{ l^((o)Card (H a r\E) dP(co) 

C JQ. 



and 

/ o o /" 1 (y) = {/ (00), <p ffl (jc)) ; 0) G ^, x 6 = dsi. 
Let now X (resp. <p) be the restriction on £2 of the r.v. X (resp. <p) defined in (01, that is, 

X(co,x) = x,P — a.s., 
(Pco y x(y) = Vioiy) for all y G £,P - a.s.. 

Then, as in ©, 

(12) lo0 = p(l),P-a.s., 

thus X is a solution to (T} on (£2, J^", P, 0) . We have proven the following result. 
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Theorem 1. If some random set G satisfies (0 and (O, there exists a stationary extension 
(n,^,P,0) of (n,J^",P, 0), given in Proposition^ on which the equation (Q admits a 
solution X, given by rf72l ). 

4. 1 . Resolution on the original space. Assume in this sub-section that © holds together 
with (|9]l. The Ergodicity of the dynamical system obtained in Theorem Q] is not a by- 
product of the construction, as easily understood, and similarly to that in |[8] [T3] . Notice 
nevertheless that the invariant sigma-field is easy to identify: let 

J = {{co,x); co G £/;xeI m } 
be a ©-invariant event of & . Then, as 

Q- X J = {(©,*); co G 0-V;* G (cp^y 1 (7 e<B )} , 
,y = 9~ l y amounts to 

\ \/COe£/,I ei o = <Pw(Ico)- 

Then, in view of the ergodicity of 9, all invariant of (£2, J^,P, 0J can be written, up to a 
P-negligible event, as 

(13) jr = {{co,x) eCiixeico}, 

where 

(14) ha = <Pm (Im) ,P-a.S.. 

A simple criterion of existence for a proper solution of (fl]i on the original space is then 
given in the following Lemma. 

Lemma 3. There exists a bijection between the two following sets: 

J ' := jis - valued solutions o/(Q on (£1, J^P, 0) smc/i f/zaf P [X G G] > j 

< — > J€ := < 9 — invariant sets of the form ( 1731 ), s.t. Card I — 1 a.s. 



Proof. Let X be an element of ^ , l m = {X(co)}, a.s., and 

J zr = {(a),X(a)));coG£2}. 

We first have to check that J G i.e. that X G 77, a.s.. Remark that {X G G} is 0- 
contracting, since a.s., whenever G G ffl , 

X(0o>) - <p ffl (X(fl>)) G <p ra (Go,) C Ge ffl . 
This event, which has a positive probability, is thus almost sure. Hence, by 0-invariance 

f]9"{XeG} =1, 

therefore X G 77, a.s.. On another hand, 

hco = {X{9co)} = {(pa, (X(o))} = (pa, (/a,) , a.s., 

so that J? G J€ in view of (fl4l . 

Conversely, given = {(©,/(©)) G £2} G J^, it is easily seen that the r.v. defined on 
(£2, ^,P, 0) by X(co) — i(co) is a Ts-valued solution to {T). Moreover, a.s., 

X(fl>) = i(fl») G77a, CGo,, 
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so the r.v. X is an element of J". □ 
Then, readily 

Corollary 1. There exists a solution to (0) on the original probability space, possibly 
taking values in G, iff J(f is non-empty, which is the unique such solution iff J(f is reduced 
to a singleton. In particular, there exists a unique such solution whenever c = 1. 

We now address the closely related question of convergence of the embedded recursive 
sequence. Remember, that we denote for^-valued r.v. X, 

Xx,„{co) = (p g „- l(0 o...o(p (0 (X(co)), a.s., 

the value after n steps of the recursion initiated by X and driven by (p. 

Corollary 2. Whenever J?T is non-empty, any element of J? is the weak limit of some 
sequence {Xy,„} n£N , where Y is some E -valued r.v. such thatY G G, a.s.. If moreover 

(15) P [For some N the set H has a finite cardinal^ > 0, 
the latter convergence holds with strong backwards coupling. 

Proof. It is clear by the very definition of H that for any X G J? , for some r.v. Y such 
that Y G G, a.s., the sequence <t>" (Y) = {Xy. n ° ^ "}„ £ n conver g es a - s - to X. Hence, by 
0-invariance the sequence {Xy tll } neN tends in distribution to X. 

Now, on the event in (JT3J, for any y G m , there exists x G G e -N{a) m such that 
y = <Pto Oe-iffl ° - ° %-N(m)m M) ' 
so that y G (pa, (h^ 10 ^ . Hence, 

„JV(ffl) + l (m n{(0 A 

which implies that the event in (TT3T > is ^-contracting (taking N(9(o) = N((o) + 1), and 
hence almost sure whenever $15[ holds. Therefore, in that case there exists a.s. an integer 
N' > N such that for all n > N', H" = H. Hence, for any Y as above, X = <$>" (Y) = 
Xy, n o 0~" a.s. for all n > N ! . In other words, there is strong backwards coupling between 
the sequences {Xy t „} neN and {X o 0"}„ eN with coupling time N' . □ 

4.2. Applications. We present hereafter several cases in which TheoremQ]applies. 

Proposition 3. Conditions (0) and (O are met, and then Theorem\l\applies, in the follow- 
ing cases: 

(i) Some deterministic finite subset F ofE is a.s. stable by (p; 

(ii) The random map q> is itself a.s. continuous and <-nondecreasing; 
( Hi) ( HI ) holds and for some solution Y to (f2]l, 

(16) p[t<o]>o. 

In this case, a unique E-valued solution X to (TU exists on the original proba- 
bility space, to which all sequences {^z,n}„ eN , Z <Y a.s., converge with strong 
backwards coupling; 
(ivj (HI) and (H3) hold; 
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(v) For some collection §? of E-valued r.v.'s, there exists an integer p, a finite random 
set B and an event §S of positive probability, such that for allZ G and all n > p, 

X z ,„eBoe" on Q- n SS. 

If additionally, P [Card B = 1] > 0, a solution X to Q exists on the original space, 
to which all sequences {Xz,„} n€N , Z G <S, converge with strong backwards cou- 
pling. 

Proof. (i) Take G = F a.s., so © and (0 trivially hold. 

(ii) The recursion driven by <p hence satisfies to Loynes's Theorem. See subsection 
l43lbelow. 

(iii) Suppose that (HI) holds, and let Y be an arbitrary ^-valued solution to (O. Set 

G=[0,7] a.s.. 

Then, a.s. for all y G <p<» (G a ), y = (p m (x) for some x <E E such that x ^ Y(a>). But 
in view of (HI), 

(17) y±Ym{x)±y<o{Y((o))=Y(ea)), 

so that y G Ge ffl . Hence G satisfies to (O. 

Now, as a consequence of Birkhoff 's Theorem, ( TToT l implies that a.s., for some 

N(co), Y (e- N W(D^ = E . Hence, G e _ w(m)fl) = {0 E } and 

hT ] = (0 E )} . 

Therefore, (0 holds, and c = 1 . In particular, in view of Corollary Q] a unique 
solution X to (HJ exists on the original probability space, that is such that 

P[ieG]=P[i^y]>o. 

But on the event {X ^ Y}, again in view of (HI), 

XoO = (p(X) ^ y/(X) ^ y/(Y) = Yo0. 

This event is thus 0-contracting, and hence almost sure. This shows that X is the 
only E-valued solution to ((T). The strong backwards coupling property readily 
follows from Corollary|2] 

(iv) Suppose now that (H3) holds additionally to (HI). Let Y be a proper solution to 

and L C E be a locally finite subset of £ that is a.s. stable by (p. Thus, as in 
(iii), {5]l is clearly met as well by 

G := [0,FjnL a.s.. 

Moreover, G is a.s. of finite cardinal in view of the locally-finiteness of L, so © 
holds true. 

(v) Set 

(18) G a = {Z((o);Ze&}, a.s., 
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and let Z e ^ and Y = <p(Z) o d~\ Fix n > p and CO € e - "^. Then, G 
-(«+i)^ so 

Xk„(C0) = (p g n-l m o ... o (p eco o <p ffl (9 fl -l ffl (Z (e^G)))) 

= ^"(e-iffl) ° - ° 9e(fl-i«) ° Ve-iffl ( z ( 0-1 ®)) 
= ^z.„+i(0 _1 co) 

This is true on for all n > p, so the r.v. Ke?. Hence, 

P[fl{ffl;fl.(G.)cG„}]=l ) 

which amounts to (0. 

It remains to check ((9). Let ffle J and G G e -„ m . This means that for some 
r.v. Z G Sf , x m = Z (0~"a>) . Hence, for all n > p, as 0~"a) G 0""^, we have that 

*fi) (•*») = ^Z,n n<0 ) S B en (Q-„ a ) = B m . 

Therefore, on 33, H C //" G B. As in the proof of Corollary [2] this implies, first, 
that H is finite on 39 and second, that H is non-empty on 33 since it coincides with 
H" after a certain rank. Hence (O holds since 33 is assumed to have a positive 
probability. 

Finally, on the event {Card B = 1 }, H = H" = B for all n > p, so c = 1 . When- 
ever this event is of positive probability, the latter is true a.s., so c = 1 and we can 
set H m — {X((o)}, a.s.. Once again, the strong backwards coupling to X follows 
from Corollary [2] 

□ 

Whenever (HI) holds together with (H3), (iv) provides an alternative proof of Propo- 
sition!]] In f act , by 0-invariance of P, the sequence of probability {Po 0~"} nGN is tight 
since it is constant. So replacing P <E> 5o E by P (which has ii-marginal P - see (fTTT) ") in the 
proof of Proposition[T]would lead to the same extension (O, §F ,P , d) . 

4.3. On Loynes's Theorem. Our construction allows us to capture Loynes' celebrated 
Theorem for monotonic recursions ((4][TT]). We assume here that <p is a.s. non-decreasing 
and continuous on E. Loynes's sequence is classically defined as {<!>" (Oe)},,^- ^ ^ s 
routine to check that the latter is a.s. nondecreasing. Let a.s., Y, its supremum, that we 
assume to be E-valned. Then, by continuity, 

(19) 9(F) =Yo9 a.s.. 

We set 

G=[0,r] a.s.. 

Let n > 1 . From ( fT9l , we have that 

<Z>l(Y (9- n 0))) =Y((0) a.s.. 
Therefore, since <t>" is a.s. non-decreasing (as easily seen by induction), 

K = {^( x y, x elo E ;Y(e-"co)j} 
= K(o*);*Z,(r(e-"a>))] 

= K(0 £ );F(60)] a.s.. 
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As Y is the a.s. limit of Loynes's sequence, it readily follows that 

H = {Y} a.s.. 

Using CorollaryQ] we obtain that the only solution Z to (Q]) on the original space such that 
P [Z < Y] > is the the r.v. Y itself. Thus Y is the a.s. minimal solution, which is the exact 
statement of Loynes's Theorem. 

4.4. Renovating events. Condition (v) of Proposition [3] can be rephrased in the follow- 
ing comprehensive terms: whatever the initial r.v. Xq — X in a given collection, after a 
deterministic rank N, the recursion is valued with positive probability in a finite range de- 
pending only upon the sample. We will give in Section [5] a concrete application of this 
result, which is, clearly, a generalization of the concept of Renovating events (see J6l and 
[4|, p. 115). In fact, we have expressed condition (v) in the form that better emphasizes 
this connexion. This will allow us to show readily that the typical existence and coupling 
result of Renovating events theory (Corollary 2.5. 1 in [4]) is in fact a particular case of (v) 
of Proposition^ 

Let us briefly recall that a stationary sequence of events {9~ n £/} ne ^ (where si is of 
positive probability) is termed sequence of renovating events of length m £ N* for the 
recursion {X n } n ^ whenever for some /s'-valuedr.v. j3 (where E' is some auxilliary space), 
some deterministic mapping \P : (E') m — > E, for all n>m, 

(20) X„= l P(j3o0"-"',...,j3o0"- 2 ,j3o0"- 1 ) one-("V. 

Now let 3f a collection of r.v.'s, for which we assume that all sequences {Xz.„} nGN , Z 6 3f , 
admit the same sequence of renovating events {9~ n £/} neN , with the same length m and 
same function VP. It is then straightforward that (v) holds. Take indeed & := 2£ , S3 := 9 m si 
and p := m. Then, for all n> p, 9~"38 — 6~( n ~ m 'si, so on this event, 

X z .„{co) =vp(j3o0"- n! ) ...,j3o0"- 2 ,j3o0 n - 1 ) for all Z e 3T. 

Therefore, condition (v) is satisfied when taking 

B= { x P(j3o0- m ,...,j3o0- 2 ,j3o0- 1 )}, a.s.. 

In particular, c = 1, so there is a unique solution to (HJ on the original probability space, to 
which all sequences {Xz,„} neN , ZeJ converge with strong backwards coupling. This is 
Borovkov and Foss's Theorem (see (6) and J4), Corollary 2.5.1). 

5. The Loss Queue 

The classical, but challenging problem of finding the stability region of the Loss Queue 
G/G/l/1 can be addressed in our framework. Consider a queueing system having one server 
and no waiting room, so that each customer is either immediately served (if the system is 
empty), or rejected upon arrival (if the server is busy). We assume that the input in this 
queue is of the G/G type, and work on the Palm space (£2, JF,P, 9) of the arrival process 

...<r_ 2 <r_i <7b = o<7i<..., 

where T n is the arrival time of the nth customer, denoted C„. The stationary sequence 
of inter-arrival times {§n}„ 6 g := {T n+ \ — T n } ne ™ is then compatible with 9, i.e. = 
B,o9 n for all n. The service times {c„} nGZ requested by the customers form a sequence 
of marks of the arrival process, which is hence as well compatible with 9 (see e.g. [4] for 
the Ergodic-theoretical representation of stationary queueing systems). We denote a the 
generic service time, and assume that a is a.s. non-negative, and ^ is a.s. positive. 
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Let W„ be the workload (i.e. the quantity of work in the system, in time unit) seen by C„ 
upon arrival. As easily checked, the workload sequence is a R+-valued recursion driven 
by the random map 

<p a (x) = [x+ o{(o)l {x=0} - £(o))] + , 

which is not a.s. non-decreasing and monotonic. Despite its simplicity, this model can 
not be handled by Loynes's framework. As a matter of fact, it is quite simple to exhibit 
examples for which uniqueness, and even existence of a solution to ([1) don't hold (see 
p. 121 - and the examples hereafter). The existence of a stationary workload defined on 
QxN, and a constructive scheme are presented in [ 8 13], whereas the existence on D. x M. + 
is proven in JT| [2J using the tightness approach, as developped in section [3] Hereafter, we 
use Theorem[T]to construct explicitly this solution, and relate it to those of l8l [T3"l . 
First, denote a.s. 

(21) A = |/>O;cro0-''-^4o0- J : >o|; 

(22) y = sup A. 

The set A thus contains all the absolute values of indexes of the customers possibly in the 
system at time 0, which are those who found an empty system upon arrival, and did not 
complete their service at 0. 
Remark, that 

Lemma 4. The r.v. y is a.s. finite. In particular, there exists an integer g such that 

(23) g = min{n>0;P[y<n] >0}. 
Proof. It is a consequence of Birkhoff 's Theorem that 

n 

(7 0-"- V EoQ-j — H»a.s„ 

7=1 

so there exists a.s. N < +°° such that the latter expression is non-positive for all i > N. In 
particular, a.s. y <N < +°°. For any n such that P [N = n] > (such integers exists since 
N < +°° a.s.), P [y < n] >0,sog is well-defined. □ 

In view of the above remark, on the event {y < g} the workload at time is an element 
of the set 

B:= jao0-'-£^o0-;;/=l,...,gj. 

In other words, for any /^-valued r.v Z and for all n > g, <f>" (Zo 0~") £ B on {y < g}, that 
is to say 

W z ,„ eBo6" on 6-"{y<g}. 
We are thus in the case (v) of Proposition[3]taking G := M.+ a.s., p :— g and SB — {y < g}. 
Theorem [T] thus applies to the workload sequence: there exists an extension (Q, J?,P, 0) 
on which ([T]) admits a solution. 

We aim to compare our extension to that presented in 0. Let us briefly recall the 
construction proposed therein. Define almost surely, for all i G N, 

i + 1 if C-j, provided he found an empty system upon arrival, 
^c»(0 = { is still i Q service at Tq— , 

else, 
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and for all n > 1, 

£ffl(0 = Vi<a ° V 2 co ° - ° V"(b(0- 
In words, L"(i) represents the index of the customers present in the system at Tq — when 
assuming that customer C_„_, found an empty system upon arrival. Denoting then H'^ = 
L^,(N) and H m = n ;J >i H^, one can show (see [8]), as in Lemma|2l that H is an a.s. finite 
subset of N having a deterministic cardinal. Hence, an enrichment (Cl, & , P, 0) exists, that 
is defined similarly to that in Proposition|2] replacing <p by I and H by H. Moreover, ([T]) is 
solved on this extension by setting 



X{(0,i) 



cr(0- ! a))-^§(0-^) 



,P — a.s. 



<Pa,i = 9ffl,P-a.s.. 

As shown in the next Lemma, (Cl,^,P,9) can be projected onto the extension (£2,Jp" ,P,Q) 
constructed by Proposition^ 

Lemma 5. The following mapping is a.s. surjective: 

Ha — > H m 
i ^^(0), 

where 4>^, (0) is naturally set to 0. 

Proof. Fix a sample CO, and let us first check that F m maps H a onto H m . Let j £ H a . For 
all n > 1, there exists i„ £ N such that y = L" m {i„). In other words, for the sample (0, C-j is 
in service just before time Tq whenever C„+ !n entered an empty system, hence 

*S+*-(0) = *4(0)=F o (y). 

Therefore, F ffl (j) 6 3>a + '" (M+), so there exists n' = n + i„ > n such that F m (j) £ h£. This 
is true for all n > 1, hence F e) (y) e i/o. 

Now, to check that Fa, is surjective, take x £ and let for all « > 1, x„ S [0,T (0~"O))] 
be such that x — <f>^ (x„). First, as shown above, there exists j £ {0, 1 , 7} such that 

-^ = *4(0)=F fi) (;). 
Fix now n > 1 . Then, assuming that for all n>n, 

Xli {(0)- £ §(0^©)>O 

;'=«+! 

would contradict Birkhoff's Theorem (remember that E [<!;] > 0). Then, there exists h>n 
such that — L" = „+i ^ < 0, which means that either (i) x„ = and the system 

was empty upon the arrival of C-„ or (ii) C_,7 found a busy server upon arrival, having 
a residual workload of x„, and the customer in service at that instant has left the system 
before the arrival of C_„. In both cases, whenever C-a found a workload equal to Xr upon 
arrival, there exists an index h £ {n,n + 1, ...,«} such that the system is empty at the arrival 
of C^. In other words, <S>% (x n )) = ®%{0). 

As a consequence, there exists a non negative integer i„ :=h — n such that 

^(0)=* = *2,(**)=*£*(0), 

which amounts to say that j = L n m (i n ). This is true for all n > 1, hence j £ H a , which 
concludes the proof. □ 
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We now introduce two simple examples (given in |4|, p. 122), in which existence or 
uniqueness of a stationary workload don't hold on the original probability space, and ad- 
dress the stability problem in our framework. We work on the following elementary ergodic 
dynamical system: 

£2 = {©1,0)2}; 
& = £»(Q); 
P := uniform on £2; 
9 : ©1 < — > ©2. 

Example 1 

Set, say, 

f 4( ffll ) = 1; 

\ ct(©i) = 1,ct(©2) =:y >2. 

We will only treat in detail the case where y ^ N and [y\ is an odd number. The other cases 
are analogous. Then, readily 

= {1,3,5,..., LyJ},y(©i) = [y\; 

= {2,4,6,..., \y\ - 1}, 7(0)2) = L>'J - 1. 

Let i £ A ffl , and fix n > 1. Then, it is always possible to find an x £ K+ such that when 
assuming that the recursion equals x at the arrival of customer C_„, C_, is in service at time 
0. Indeed, 

• If n is odd, 

- If n = i mod. ( [y\ + 1 ), say n = i — 2 + p ( \yj + 1), set 

W-„ :=x = 0. 

Then C_„ is served, and 

w -('+(p-i)(LvJ+i)+i) 

=y-{(i+p(LyJ + i))-(i+Cp-i)(W + i)+i)} 
=y-bJ>o, 

whereas 

w -(<+(p-i)(Lvj+i)) = b-{W + = 0. 

Therefore, C_( I+ ( p _i)(L v j+i)) is served and by an immediate induction, all the 
customers CL^, where & G {j, 1} and k = i mod. ( [y\ + 1) are served. 
In particular, C_; is served, and is still in the system at 0. So 

^ (*) - a o e-'C©, ) - £ § o e-^oh) = y - *; 

7=1 

- If n = i-2£ mod. ([yj + 1) (say n = +/>(bJ + 1)). set 

W- n :=xe (\y\-2£,\y\-2e+l . 

Then, 

+ + 

= Jt-{(i-2^ + p(bJ+l))-(i + (p-l)(LvJ+l) + l)} 
= x-{LyJ-2^}>0, 
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whereas 

W -(i+(p-D(bJ+l)) = -2£+l}]+ = 0, 

so C-(i+( P — i)(L>J+i)) i s served, and as above, all CL* where 
k G {/,....,(/+ (/7 — 1) ([yj +1))} and £ = / mod. ([yj + 1) are served. Here 
again, C_; is thus served and (x) = y — i. 
• if « is even, set W_„ = x + 1 for the different values of x set above, so that 
WL(„_i) = x for n — 1 odd and we can apply the above argument. 

Therefore, in any case, for all and all n, there exists x G K+ such that <J>^ )[ (jc) =y — i. 

This shows that y — z' G H a > l for all such z. On the other hand, provided some customer C_„ 
is served, where n is even and n > |yj , the service time of C_„ is 1, so C_r n -\) is served as 
well. Then n — 1 is odd with n = i — 2 mod. ( [y\ + 1 ) for some i G A ra , , so as above C_, is 
in service at 0. In particular, there is always a customer in service at time 0. 
Therefore, for all n > \y\ + 1, 

{y- r, i G Acoj } C C 4>'^ (M+) c {y- i; i G A^} , 

hence 

Hon = {y- l,y-3,y-5,...,y- [y\}. 
Analogously, we can check that 

= {y-2,y-4,y-6,...,y-(bJ-l),0} 
(indeed the system may be empty at for the sample a>2 whenever C_^j +1 is served). In 
particular, c = ^ • 

Now notice that q> ai (y — i) = [y— (/+1)] + for all odd i such that i < [yj, whereas 
90)2 (y ~ ( l : + 1 ) ) — y ~ (' : + 2) for all odd z, z < |yj and (po^ (0) = y — 1. As a conclusion, 
recalling dT3l > we easily check that the invariant sigma-field of (£2, J^,P, 0) is |0,£2}. In 
particular, the set Jtf of Lemma[3]is empty: there is no solution on the original probability 
space. 

Example 2 

On the same probability space, define now 

f €(o>i) =§(flfe) = l; 
\ a(o)i) =:x,a(coz)=:y, 

where x and y both belong to the open interval (1,2). Following the same lines as in 
Example 1, it is easily seen that 

A Bh ={l};A a>1 = {l}, 

and 

H^ ={0,y-l};flafc = {0,*-l}. 
It is then immediate that both events 

^ = {(flh 1 0);(ffla,jf-l)}, 
jr' = {(Gh,y-l);(a>i,Q)} 

belong to J(f in this case. There are two solutions to (|T). 
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6. The Queue with impatient customers 

We now consider a queueing model with impatient customers. We use the same notation 
and assumptions as in section [5] except that customer C„ now requires to enter service 
before a given deadline, say at T„ +D„. If not, the customer leaves the system at T„ +D„ 
and is lost forever. We consider, that as soon as a customer entered the service booth, 
his service will proceed without interruption even though his patience elapses during his 
service. We assume that {D„} neZ is a sequence of marks of the arrival process, and that 
the generic r.v. D is non-negative. The system has a single server, operating in the order 
of arrivals (FIFO). Then (see (3]|5][12|), the workload sequence {X n } neZ is stochastically 
recursive, driven by the mapping 

<p a (x) = [x+o(co)l {x < D{m)} -Z((o)] + , 

since each given customer is proposed a waiting time before entering service, that equals 
the workload just before his arrival time. Hence, the loss queue is a particular case of this 
model for D = a.s., as easily understood. We aim once again to solve 

(24) Yo9 = <p(y), a.s.. 
As can easily be checked, we have a.s. for all x, 

(25) Xm(x) < <p<o(x) < Va>(x), 
where 

X(x) = [xV(aAD)-^} + , 
y/(x) = [xV(a + D)-£] + 

(see eq. (9) and (12) in Q3). 

The random maps % and y are a.s. continuous and non-decreasing, and the only proper 
solutions Y and Z to the recursions respectvely driven by % and y/ read 



(26) Y = 

(27) Z = 



max (oAD)o9- i -YE 



max ^(ct+D) o 0"'' - £ £ o 0- j 

Then, if P [Z = 0] > 0, we are in the configuration of (iii) of Proposition [3] and a unique 
solution exists on the original probability space. 

If P [Z = 0] =0, a construction based on tightness arguments is proposed in [12], that 
establishes the existence of a stationary workload on £2 x R+ provided that a and % both 
take value in a set of the form 

(28) L a := {na; n E N} , where a e K + . 

In fact, Theorem Q] applies, and we can explicitly construct the extension in this case. 
Indeed, clearly <p(x) G L a a.s. for all x S L a , so that the recursion, when initiated in L a , 
remains in this set forever. We are thus in the case (iv) of Proposition [3] taking L = L a . 
More precisely, as in ( TT7T > and in view of d25l l. we have a.s. that for any Y < x < Z, 

Fo0 =x(Y) <x(x) < <p(x) < y(x) < w( z ) =Zo0. 
Hence, the random set defined by 

(29) G = L a n[Y,Z] a.s. 
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satisfies to ©. Moreover, Z is a.s. finite (see Lemma [6] below), thus G is a.s. of finite 
cardinal. So does H: ^ holds true and Theorem[T|applies. 

Size of the extension. Let us investigate more precisely the form of the extension. First, 
denote 

(30) 5 = min{/i£N;P[c7<na] >0}, 

(31) .f=inf{«6N;P[c7<«a] = l}, 

(32) d = M{neW,V[D<na] = 1}, 
where s and J may be set to +°°. Denote, a.s., 

A 

T+ 

(33) B 

Each customer spends in the waiting line (resp. in the system: waiting line + service booth) 
a time at most equal to his/her patience time (resp. his/her service time plus his/her whole 
patience time). The set A (resp. B) thus contains all the absolute values of the indexes of 
the customers possibly in the waiting line (resp. in the total system) at time 0. Finally, T + 
counts the number of arrivals customer can see during his/her patience time. 
Similarly to Lemma|U 

Lemma 6. The r.v.'s p, %~ and T + are a.s. finite. In particular, there exist two integer p 
and t such that 



= j; > 0; (Do9~') -^^o6~ s > j and T~ = supA; 
= min | j > 0; £ | o j > D j ; 

= jz' > 0; ((jo O^+D o 0-'') - £ % o Q-i > o| and p = supB. 



(34) 
(35) 



p = min{« > 0;P[p < n] > 0}; 
t = min {« > 0;P [t _ < n] > 0} . 



AsHCG a.s., we have that 
(36) c < Card (L a n [F;Z]) = Card ( I ■ i 
Now set a.s. 



Z-Y 



a 



Z-Y' 



a 



a.s.. 



k) = argmax < a o 0"'' + D o 9^' - ^ | o e~ j ; / e N* 



argmax 



c7o0- , ' + Do0- , '- ^oe^';i= l,..,p 
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Then, 



Z - Y < a o d~ io +Do 0~'° - £ § o 6~ J 

;'=i 

/ io > 

- [ (cTo0-'<>)A(Do0- ! ")-^4o0-^ 
= (cro0-''o) v(Do0-''") a S i 



so that, with 



c< 



max<^ ((TO0-M V(Do0-M ;/= l,...,p 



Therefore, on {p < p}, 



(37) 



c < 



a 



max <^ (aVD)o0-' 

<=l,...,p [ 

a 



a.s.. 



On another hand, the largest possible workload at time is less than the sum of the 
service time of the customer in service (whose index has absolute value in B) and the ser- 
vice times requested by the customers in the waiting line at (their indexes have absolute 
values in A). Therefore, a.s., 



(38) 



HCH"CL a f]i [J 



vies 



cL„n 



O;t7o0- ! '+£(ao0-;')l A {y} 

p-i 



O;cto0-p+£ (aoB-J)l A {j} 



cL„n 

= L a H [0;M] 



O;ao0-P + £(ao0^')l A {j} 



where 
(39) 



M:=ao0-P + £(ao0^')l A {j}, 

y'=i 



and where we use the fact that T < p , a.s.. This implies that a.s. 

-Mi 



a 



= £ + 1. 
a 



(40) c < 

On the event {p < p}, we have T~ < /?, thus M < ( a ° ^ ; ) > an d with ( 140b . 



(41) 



c< 



£(ao0^) 

7=1 



a 
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Now, on {t < t}, 



so with (gOK 



(42) 



M <Go9~ p + Y, (ood~ 3 ) 
.7=1 



max (Tofl-' + r'n (ffofl-i) 

. i=i,...,p J v , 
c < h 1. 

a 



The upper bounds d37l i. (l4TT i and (l42l i hold with positive probability, hence they are true 
a.s. since c is deterministic. Therefore, 



if . t 

c< 1 + — .min< max (cto0 ') + ^(cro0 •') 

01 I i—l,...,p j_ | 



7=1 



i=l,...,p 



;E (aofl-J); max (ao 0"'') V (Do 8~') \ a.s 



If we assume in particular that the service times are a.s. bounded, i.e. that s defined by OTb 
is finite, we have that 

c<s((t + l)Ap) + l, 

and if additionally, the patience times are a.s. bounded (i.e. d - defined by ( T32T ) - is finite), 
it follows that 

c<j((f + l) Ap)A [sVd\ +1. 
Now, remark that for all j > 0, a.s. 

i-l 

t+ o d~j > j Do 0-;' > £ 4 o 0*-; 7 GA. 

k=0 

By the very definition of T, 

T+-2 

E $°e y <A 

7=0 

so taking expectations, and then using 0-invariance we obtain 



E [D] > E 



E 



.7=1 



(^ofl-^EVofl-^ 

7=1 

(43) =E[(^o0- 1 )CardA] . 

Again, if we assume that s is finite, it follows from d39b that 

M<sa(l+CardA) a.s., 

so with d40l >, 

c<s(l+CardA) + l a.s.. 
Plugging this into d43l . and using 0-invariance thus yields 

- S -(E[D]+E[$]) 



(44) 



c< 



All these results are collected in the following proposition. 
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Proposition 4. A stationary workload exists on the original probability space whenever 
P [Z = 0] > 0, where Z is defined by If not, if both (7 and £, take value in L a defined 
by ( 1281 ), we have that 



1 f 

(45) c<l + -.nW max (ffoe H ) + £(ffoe^) 



, =1 i=l,...,p 



;£ (ff°r J ); max (aVD)o0-' j I a.*. 



where p and t are defined respectively by ( |34| ) ana! ( |55| ). 
If additionnally s defined by ([37]) is finite, 



c<mm<s((t + l)Ap) + l; 



j(E[D]+E[fl) 



and if d defined by \32\ is as well finite, 

c< [sVd\+l. 

Let us go through two examples to illustrate how our extension technique can be used 
to solve the stability problem of the queue with impatient customers. We work on the same 
dynamical system as in Examples 1 and 2. 

Example 3 

We first consider (a particular case of) Example 1, p. 303 in |[l"2"ll . We set on (H, J£",P, 9) 
the r.v.: 

a(£»i) =0.5, (7(0)2) = 1.5; 
D(ft)i) = 1.51, D(fl)2) =2.01. 

The workload is then valued in 0.5N, and we check that for this model, according to the 
definitions ( T26b and (fSTJ, 

Z(ft)i) = max|cj(a)2) +£>(o)2) - ; (7(0)0 +D{co l ) - (§(flfe) + £(ft>i)) ; 
= 2.51; 



Z(a)2) = max| cj(o)i ) +Z)(coi) -|(<»i); a(flfc) +0(flfe) - (§(ft>i) + §(©2)) ; 

= 1.51; 

r(fih) =0.5; 

F(0)2)=0. 

We thus start from the set G = [Y,Z] H0.5N, so 

G ffll = {0.5, 1, ...,2.5} , = {0,0.5, 1.5} . 
It can be checked as well that 

A mi ={1} and = {1,2}; 
Bp, ={1,2,3} and B^ = {1,2}, 
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so t = 1 and p = 2. The least upper-bound of c obtained according to Proposition's given 
by 

[sVd\ + l = L1-5V2.01J +1 = 3. 
To explicit construct the extension, we now form the random sequence {H n } for the sample 
0)i : 

*4 = 90,(0^) = {0.5, 1,1-5,2}; 

Hl l =(p mi o ( p mi (0^) = ^({0,0.5, 1,1.5}) = {0.5, 1,1.5,2}; 

H li = <P<»2 ° <?S ° (Goh) = <Po>2 <Pe>i ({0.5,1,1.5,2}) = {0.5,1,1.5}; 

^ = <P<»2 ° <Poi ° 9»2 ° <iV ( G fl)i ) = <P»2 ° <P<»i ({0.5,1,1.5,2}) = {0.5,1,1.5}; 

< = 9^ 09^ ({0.5, 1,1.5}) = {0.5, 1,1.5}; 

H% l =(p mi o 9mi ({0.5, 1,1.5}) = {0.5, 1,1.5}; 

Therefore, = {0.5, 1, 1.5}, and we obtain likewise thati/,^ = {0,0.5, 1}. So c = 3 and 
there are at most three solutions on the original space. 
In fact, it can be checked that the following events of J^: 

J = {{co u 0.5); (02,0)}, 

y' = {(oh,l); (ft)2,0.5)}, 

J" = {(©!, 1.5); (0)2,1)} 

all belong to the set of LemmafJ] As a consequence, the extension is not ergodic, and 
the three corresponding r.v.'s X, X 1 and X" are the only three stationary workloads on the 
original space. 

Example 4 

Now, set on the same probability space: 

Sfa) =£(flfe) = l; 
a(flh) =3, ct(cd&)=2; 
D(coi) = 3.01, D(©2) = 1.99. 

The workload sequence is then valued in N. As above, we first check that 

Z(0)i) =4.01 and Z(afe) =5.01, 

F(fl)l) = 1 and 7(0)2) = 2, 

A ffll ={l,2}andA ( „ 2 = {1,3}, 

B mi ={1,2,3,4,6} andfi^ = {1,2,3,5}, 

so that t = 2 and p —5. So the smallest upper-bound of c given by Proposition's 

[sVd\ +1 =4. 

Once again, we set G = [T,Z] nN a.s., which amounts to 

={1,2,3,4} and = {2,3,4,5}. 

Then the computation yields 

H mi ={2,3,4} and = {3,4,5}, 
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therefore c = 3. It can be checked in that case, that the invariant sigma field of # is 

so the extension is ergodic, but there is no stationary workload on the original probability 

space. 

Independent case. We now address the case where the service times, patience times and 
inter-arrivals times form three independent i.i.d. sequences: the system is then denoted 
GI/GI/l/l+GI, and has been thoroughly studied e.g. by Baccelli et al. (J3]|5]). 
First, assume that 

(46) P[a<£]>0, 

which implies, by independence, that P [a < y — e] > and P > y] > for some y, £ > 0. 

The r.v. Z defined by d2Tb is finite, so there exists neN such that P [Z < ne] > 0. In 
particular, by 0-invariance, 

P[Zo0-" <ne] >0. 
Denote now for all i £ N* and all x 6 R.+ the events 

£? = {!;oe-]>x,\tj = \,...,i}; 
&f = {ooe-Ux;\lj = \,...,i}, 



fix a sample on the event 

srf n := {Zo 0-" < ne} n ^ n J^~ £ : 
and assume that customer — « finds upon arrival a workload w such that 

w e G e -„ a = L a n [y (e-"co) , z(e-"co)] . 

We are in the following alternative: 

(i) either for all q = 1, ...,n — 1, the workload < J > g4 / (B ( vv ) u P on me arrival of C- q is 
positive, so the server never idles before the end of service of customer C-\. In 
that case, the workload <J>^ (w) at is less than the workload upon the arrival of 
customer — n plus the work brought by the customers C-„,C_(„_i), ...,C_i minus 
the time elapsed, in other words 



Hence, since CO € 



■£ao0--''((o)-^§o0^'((») 

7=1 7=1 



4>" e) (w)<[z(0-"co)+«(y- £ )-«y] + 
= 0. 

(ii) or for some q e {1, ...,n — 1} (take the largest one), ^-^(w) = 0, the system is 
empty at the arrival of C_ 9 . Hence, since 

Ooe-J(a))<%o0-j((0);j = l,...,q, 

each following customer is then immediately attended upon arrival and leaves the 
system before the next arrival, so ^Q-^fw) = for all j £ {0, ...,<?}, and in par- 
ticular 4>£, (w) =0. 
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Therefore, in any case and for any w £ G g -t, m , (w) = 0. Thus, H = {0}, and in particular 
c = 1, on si n . It is now easy to check that P[£/„] > since the events {Zo 9~" < ne}, 
Si and &\ 8 are clearly independent and of positive probability. Thus, c = 1 a.s., the 
extension is ergodic and there exists a unique solution X on the original probability space, 
for which P [X = 0] > 0. We hence capture again the stability result of Baccelli et al. (see 
00). 

Assume now that (|46| | does not hold. Notice that 



= {P[a<sa]) n >0, 



where s is defined by (13 Oi l. As above, it is then easily checked that the events {p < «} and 
G~ n are independent, thus 

P\{p <n}r\Gf] >0. 

On the latter event, M defined by ( |39l > is such that M < jc (1 + Card A). Therefore the 
argument leading to d44bvields 

Card//< ^ U_ 
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